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ABSTRACT • ■ -.. 

^ • COPES (Community College Occupational, Programs ' . >- 
Evaluation System), established -in 1S71 as a cooperative undertaking 
of' community colleges, is today the recpgnized systee for evaluation • 
of occupational effucatidn in Ca'liforcia community ctilleges. In i^s 
fifth' year of >operation .(1975':76) an assessment 'study focused on the 
baiic system; Ke-y' ebjectives of tiie» study were to^ securejCpPES impact 
data fro E 'co:^,leg«s "that had participated i]j the sys-tem,- assess the ^ 
clir^ent system and iaake appropriit.e,. revisions, and publish revise d- 
syste«i guid-es'. A 12-me;iiber revision commj,ttee monitored the .study , and 
'served* ai^ the decisf cnmaking bo^y r eg ardiaaiiiiro posed refinements. 
Thirty-nine colleges responded .to a questionnaire, ^nd. two key* . 
findiags emerged: (1) Oral and writ terii}|Jeports of the. COPES teams, " 
were highly useful' to the colleges in planning for occupational * 
education prbgratf changes and {% many benefits^ res uj. ted in teriffs .of 
impact ^on students and, education improvements.^ (Narrative descriptj-on 
• o-t. - ^-i .ire;\a^:companied ty supporting tables, ^ 



of response's, to the ^uestxonnai]^ . _ . _ 

and .resultant actions by" COPES .management make ,op, the b,ulk of the ^ 
document,. -along/with 34 pag^s-of appendixes^ ' which conJ:^n names 6f ,j 
coop.erating colleges, 'copES project participants, and details on both 
the ^n^act assessment and system assessment.) "'"^'^ 
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..... . . , ^ . :) * ^* * ' ' ^ 

COPES. (Community ColTeae Occupational .Progranj? Evaluation, System) 

• "'--^ r ' * ^ ^''4 * * 

was established in 1971 as a cooperative undertaking .of comfnuaity college 
leaders and the Chancellory's Office of the Ca.l iforaia Community Colleges. 

Since then the system ha^ been applied at apprSD)cimately, two-thirds 
of all ,the community colleges in the st^ite, four evaluation 'subsystems 
have been dev^lo'ped, and-hearly 200, educators' and commu/iity representa- 
tive^"^ have been involved in service "a s'^H'n implenientebtion cadre*.- 

As a result, COPES today js the recognized system fgr^evalu^itioft 
0? bccupatipnal- educatiorr in C&l if ornfa. community colleges. 

• - lis progress and pfesent-st^ature must be credited in significant - / 
measure* to] the cooperative leadership mbdpl which 'has provided COPES an 
outstandingly broad and deep base.^ 'This fnodel jncludes the Chancellor's 
Office, in the role. of sponsorship; Foothill-De Anza CpjnmunitxOpI lege 
.District, in' project management; and commuilil^ col leges ^throughout thfe 
State, ih. cooperative ipartjcif^a^ At the-Qfeahcellor's Office, direct 
supervision j's assigned to Dr. Bill Morris, evajuation specialist, . * , 
division df occupatiotial education; at FoofhilJ-De Anza district, jnanage-r 
ment'.is the. Vespops^ibility of Dr. Nathan Boortz*, director 'Of technical 
educatioft', wi tji- Dr. ^George, W. Ebey, of George Ebey Associates, as project 
coordina.tcrr.': . ^ - — , r - , '^^ ' ^ ^ / 

* From. the outset, the goaj of COPES has bee^ to iiriprove the j|uaTity 
and availability pf'occ^upational education in ^Caltfornta community 
ccrl leges. . * - ' . ^ / 

.Also frbm* the outset, to, monitor the.work'ings 'of the basic system 
aifd the subsystems in the light of that goa-l , project leaders' have, con-* 
tinuingly and systematically been engq^ed in evaluation of COPES itself. 
They have,, at the'end of each year, obtained infgrmation on improvement ^ 



aptions ta^ken T)y, tW ^cooperatin^ colleges as^ a result of COPES evaluations 
- c^nduct^d during, the year. They haye secured perceptions 'from literally ^ 
thousands- -of participants as to the effectiveness of* the/COPES. process •/ 
arid each year ^hrave utilized the participants'* many suggestion's in re- ; 
" fining' the system and su})sy$tems. ' - . , 

Fruitful thoCigh these' efforts have been, 'it wa^ determined that 
eOPES* fi'fth year in 1975^76' would bfe'an -appropriate time to placer 
gpeater and more comprehensive emphasis than ever, before on evaluatioh 
of CaPES^, in' terms 'both of products 'and processes'.* With^respect to 
-products, Ibokiiig at college actions resulting from COPES self-studies 
during' 1972-73 through. 1974«75 would give a solid indication ^s to " 
whfetK^rXOPES was^ really ^producing- worthwhile results in keeping with 
'it-Sj9t5al. With respect to'^ processes, and again w^th 'COPES' goal *in / 
^thd,^ an overall second look at. the system wpuld^ermit updating COPES- 
^to 'insure that it cfan proyide most .useful local and stafewide management * 
-information. / 4 r - ^ ■ ' ^ 

^.Therefore a ^special COPES assessment study was planned to con- , 

ducted during the j^ear. It was further decided that this sfudy would ^ 

focus on the basic system, not only for reasons of its total qdverag^ 
*»* ' .' ' - . * 

bu't because 'it 'provides the^design and application patterns that are 

'* ^ • / • ' ^ 

also* common to all COPES subsystems. . ' 

\, . ^ / ^ 

-. * • . ' ->-' V' \ .-.),■ 

Objectiv^es of the -Study / ; / ^ • . 

.'^•The key objectives' of tfje -study w^e tp: - ' 

Secqre COP€S impact ''data from^ colleges Which had participated 
' in appHcations .of ^the system from 1972-73 through 1974-75, 
/ (copes; first yeac/, 1971-72, wasi a developmjental and field- ■ 
testing' period-. ) j'. ' ' ' ' - 

• Assess .the current system; with widespread participation, 
and make- revisions as appropriate. 

/ . 'B\ TuMi5^ revised system guideSj^ iriclOding instrumentation 
; • • and crit^rial 




« « 
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Method yjf Approach , ^ - ' * • . . ' 

1. Plans or tKe study were submitted to and reviewed by the COPES 
Planning and fote^al Evaluation Committee. The Study* s. impa*ct component 
involved the standard COPES procedure of college self-stydy, and outside^ 
'validation ot the' splf-study ftridings. \ ,* ^ 

2*. ' A 12-fnemfeer COPES Revision. -Committee was formed to jnonitor t,he^ 
study and serve. as the decision.-mak'ing- body regarding proposed" refine- 
'menrt^ in the system: This committee included representation from project 
management; the ChancelTbr *s .Office', and tihe Califorthia Advisory Council 
tfn Vjocational Education, as well as persons from the field who are- 
knowledgeable" of COPES and its applications.^ ■ - . . 

3. System refinement suggestions obtained irt T974-75 and, as thdy . 
became available, in 1^975-76 from cooperating colleges' feedback, and 
COPES validation team debrief iags, were synthesized. at the COPtS Service 
Center. They were made available' for Revision. Committee, ana-lysis as one 
basif for modification of procedures* and instrumentation. • . ' 

4. A questionnaire'was sent , to ^ the ^42 cdlleg^ which had applied 

the COPES overall* system during the three years' -covered by'the study. < 

The questionnaire sought information on* difficulties encountered in * 
* . • .' * ^ 

implementing the^ COPES recommendations, impact on s^;udents -brought i ^ 
* * • ' * * • ^ ,* ** 

about by implementation oft the recommendations, -resultant improvements 

in. the 'quality and availabil.i ty of occupational education at^the , 

colleges, needs ftjr j'mprbveWnr in COPES, quality of the oral and 

'written COPES reports* to the colleges, and extent.^of college distribution 
of the written reports. Thirfy-nine colleges responded. Typicajly the 

.respondent was the collegers occupational dean. . - . ^ . - 

5. ^>6uid^, instrumentation, and Jbriteria refinement proposals, Were 
fdrmuldted\by a study' subcenTi|vh:tee^ especially^established^f or this 
purpose. ' - . . ^ ' ' . 

6. Members of the Rgvis'ion Committee visited a random sample of 
18 of the cooperating colleges, to validate questionnTiire responses. Twp 
hundred forty-three Injfcerviews were .conducted during the^e visits-- ' 
chiefly with superintendents and presidents, other administrators^, 



instructor^,, eounselonsp and other staff members. In addjtiori, a wide • 
variety of verifying evicience was reviewed. ' . • - • • * . 

t 7. On the ibeTsis of all pertinent .inputs,, the Revision Committee 
identifledc changes needed in the^ba-sic system. , ' ' ' 

^ ' 8? These changes were effected, and revised gujdesV "TScTu^ing 

instrunfentation cirxi criteria; Were plrepared for' publication. ! Pfapning 
'also-was begun^for revision of COf^ES audiovisual materials ^to accomfnbdate 
-the systeni changes " * . ' 

,'9. Information received from tjie colfeges an^' the* visiting. val>i- 
dators was analyzed and, together with Mictions takec by Jthe^RevJsion 
^ Committee,'^used*dS a basis for the^development'^of this written report: 
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natdrs are identified in-Appendix A. Names and'affil fatHpns of'the • 
members^ of th?" Revision' Committee, ^subcommittee, and M^nninq atid Internal 

- ( , . ; • - - ' /./ ^ - - 

^ Evaluation ,£ommi ttee" are --shown as Appendix 

Organization ^f the Report ^ ' 

•In the sections which follow, .this. )»eport 
first in summary: form and then, where" Wirra 
findings. Revision Oonwittee concurrences, 
suiting from the study. * , ' - 

As indicated above, revised guides,, in 
criteria, ay*'e tftublifbed-.^eparately, ' ' \ 




an i zed to^ prpv-ide-*- 
greater detail --impact 
refinements re- 



trumentatiorf and 




^^^^ . '> ^FIANAGEMENT DIGEST ^ i/: * \ 

^ . , CORES .has served to improve the*qija1ity and -availability* of OQCiipa- 
, ' tiona'l educatfort at California conihiunity' col-leges. *' ' 

It is^ a fundatneh tally sound evaluation system. ^ - ; • 

^ ^ . Those are the .twb Icey findfhgs, of. this special, study , undertJken to 

•^assess the -impact of COPES, at cooperating colleges* an^ the need for* 

/' -I. ^ ' ' ' ' * • ' ' -'lie \ ' < \ 

/^system re\/1sions. . . 
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Alsa> where system revision needs were iclentiftedJai1d^<ietermined to ^ 
be importcint, t^ey were quickly dcted upon. ' * * 

• ' • ^ ' » • . • • • • \ 

Imp.act Assessment, - - ' . . ^ - 

Pn the .|>asis* of responses from 39 Colleges at v»hrc?h COPES w^s'applied 
during the three;ye'ars covered, by th€ ^tudy,. arrd with va-tidation^ those 
responses at 13 of the colleges, *ttfe- following can 'be reported: / 

1 • t)fal and wrifteh repots 'of th^* COPES 4:eanis, ^^^sed''cl9.se>y4,on 

rfealistic, strengths and, weaknesses iri *ttfie Co.lleges * ^qqupa^naV edlica- 
^ ' * • • • • • • » 

tion programs, and were'hllghly useful to tTie^ctfTl-e'ges ifi^^pl^nning fbr 

^ 2. . COPES'wa^ credited. with having led' to many beneficial, results 

atrthe .coTlegesV*in" terifis of impiact^ sctgdeVits* and in occupational 

.education improvements . In all,^oJlege respondents ^joted 139 posit^ive 

/ * * * • * ' * ^ " * •* 'V- 

effects, chief -among wljich were': . , . ^ ' ^ - 

-...i^i Stren^the,n-ing of curridoTum - * ' ^ * ' . 

5tafffrfg additions . ^ / -.^ ^ 4- ^ • 

• Incr.eased'institutional recognitiori "ahd support ' of (Dccupat.ipnal 



programs , 
• Improved oc(iupa1:,ional staff 'moralfe 



' • Improved administration of pccupational education 

, - Improved placement services. . , \ / ^ 

Moreoyev, 16. acWitional positive effects were identified in the valida- 
tion process Which^had not" been noted by-the col lege^ respondents, 
bringing the averall total td 155. -On the, other hand, only six respon- 
dent 4?ientions vT^re made of n^ga,tive -effects, , mostly. 'in connection with 
attitudes of some team members. . ^ , . 

^ 3> The- above. results were obtained ,desptte difficulties enoountere/i 
by .most .of the colleges in.Mjnpl^ementing. COPES -recomnrendations* ^oney . 
'\and time provgd to be the biggest obstacles. 



N System Asse'ssment and Resultant Actions , , , ,7 

Upon- review of all pertinent .stildy input^ the COPES Revision 
•Committee decided that: ' 

_.l. The present COPES system is fundamentally sound. 

2. A follow-up revisit to determine institutjonai action taken* 

on the basis of COPES findings at all cooperating 'colleges should become 
standard- procedure., ^' - • 

3. . Major revisions should be made in ins'tif'umentation , mpst notably 
, redufcihg the number of item in'^t^e detailed percjp^ptipns instruments 

from 60 to 36, and other changes—mostly minor— should bejnade "in^the/ 
.COPES Guide. , • 

4. ^ Suggestions should be made to cooperating colleges on how • - 
the-written COPES reports might be distributed to provide., an optimum 
basis for action^ " . . . 7 • ' ' - - 

On the basis of Revision Committee decisions and other study con- 
siderations, COPES management appro^'ed: .'^ / ' 

1.. installation as standard COPES procedure of the expanded - 
follow-up* de,termi nation of college action/ v - * • 

> 2/ Publication of a revised COPES Guide and COPES Guide \ ^ 
(Instrumentation^), as recommended by the Committee. 
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3'. "Change in the form of VraFand written reporting by COPES . 
vai idatfon teams to' provide ^fQiter speci f ici ty and . sharp^r^ focus . : ' 

■ 4. Undertaking the identification of exemplary occupational 
'•education programs and practices to assist other colleges in effecting 
improvements. • ' - " ! ' . 

■5. Enlisting participation 'of counselors on validation teams. \ 

■ \ ' ■ 

6., "Development .of procedures to help colleges make the'most^ 
effect i v^. us^llDf va,l',4dati on team reports. ... , • ' 
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' . ■ COPES impact: ASSESSMENT . ■ • ■. 

" . - ■■ # 

. ' • , f 

CilWeqe Responses . / 

Respondents at Irhe cooperating colleges generally agreed that: • 

• Oral and written, reports -of the COPES teams focused on ; 
realistic strengths and weaknesses in thexoHeges' occu-* ^ 
pational education programs, and were useful in planning 
for change, 

' 6 Implementation of recommendations made by the COPES teams had 
' a beneficial impact on studenrts; ^ 

c • Applica.t1on of COPES contributed to iriiprpving the quality and 
availabilit:y of occupational offerings o-f the colleges. 

, Oral and Writtgn' Reports ^ ^' , . . , • . 

The teams', oral aqd written reports to the colleges were 'accorded 
Kigh composite ratings in all regards, as shown by Tables'Tand' 2.. 

- Concerning the oral/reports (and excluding.don 't know and^-np . 
response),, 3&||| the 37 ratings for effectiveness were^ acceptable or 
.better on a fi^-polnt scale refnging from poor to .excellent, and 32 
were good or ^cellent. All 3^7' ratings. for focui on rear! istic- strengths 
and Weaknesses wefef'acceptable or better, again with 32/good or • 
excellent. Thirty-^fi ve ratings on usefulness in'plarinibg for change 
were acceptable or better, with 30 -good or excellent. 

Concerning the written reports (don't know and no response .again 
excluded), 3-7 of 38 ratings for focus on realistic strengths and 
weaknesses were acceptable Sf better, and 34 good or excellent. Thirty- 
three of 35*ratings on usefulness in planning fOF change were, acceptable 
or better, and 29 good or excellent, ^ 

. , • ■ " • • . ■ >\ 



COLLEGE RESPONDENT RATINGS 'OF dOPES ORAL REfilRTS 




Effectiveness 

Focus ^ on real- 
istic strengths, 
weaknesses . . 

iJsefu'lness in 
planning for • 
. change 



Be1oW^ ^' ' . Don't Know 

Expecr V- ^ . ' - V • ' ' . ', 
Poor, tation^ i Acceptable . Good ' Excellent No Response 



> 



. 4 



24 



-^2 



25 



8 



14 



V 



2, 



Source: Mailed, responses. 



' Table 2 
COLLEGE RESPONDENT RATINGS OF -COPES WRIHEN REPORTS 
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— ^ — ^ 


. ' . (N =39) 


< 






BeTow 


Don't Know 



Expec- 

Poor tations Acceptabl e Good . Excellent • No Response 



■ - Focus on real - 
istic strengths, jS^' 
weaKnfesse^s .0 

Usefulness in > • 
planning for" 
■• change . ' 0 



4- - 



23. 



.20 



•Id 



9 



Source: Mailed responses. 
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Combijiing all aspects in Table 1, 97% of the^^al report ratings 
were acceptable or better, with,, 85% good or excellent; in Table 2, 95^ 
of the written report ratings were acceptable or better, wi£h 87% goed - 
or excellent. \ ' ' - 

Distribution of Written Reportf *"^^ , ^ • ' 

. At the vast majority of t.h^ 39 cooperating colleges, th'e'COPES 
team wrj tten Ve^jorts were distributed .to administrators and occupational 
facu>1ty--th6 fofmer in 36 ihstances, .the latter' in 33. (See Appendix 
c-1 . ) ■ . • ' ■ 

At only one college* wais the report distributed to academic 
faculty. ' ' • ; 

'Couni-elors received copies at 19 colleges, advisory comm'Tttee 
members a^t 9, governing board members at ..5, students at 3. 



Di^Hculties Encountered in 'implejnentih'g Recommendations . < 

.Most of the colleges met with obstatcles in seeking to improv^ 
*area/of occupational education identified by COPES as having priority 
need for improvement. (See '.Appendix C-2.) v . " 

' . Only five of 37 respondents (no reply lo the questiqn was received 
from two colleges) stated that^they #ad not ^encountpred any diff'icuHies, 
of material importance. . ' . - 

* At 12 colleges,, insuffic'ien't funds were cited; at seven, ihsuffi- . 

cient lapsed timeMpetween the evaluation and this "study. 

' ' ' ■ ^ '7 

A vafietyjbf organizational and "human element "/problems were 
• noted--including an unresol ved ^colle^e management rqle in a multi- 
college district, in three instances, anl resistance to as^signing mqre . 
decisionr-making responsibility to ;the occupational education administra- 

' tor, iR two. * ' . 

-'^ * , \ , ' \ ' ,^ ^ ' 

• X Also in two ini'ta'hces lack -oft- implemerjlation was attrii)uted to 

the »i^ture of the ^recommendations.' ' . - 



■ -Typical, among th'e respondents ' .fomments" regarding implementation 
i/ficulties were the followiner: ' ' r,- _ , 

"Needecl staff could not be^hired because 6f district restrictions 
'•'.on hiring, and money was ncft available for needed equipment and 
„" added sections in certain- areas. In spite of the^aboye limita- 
tions, our enrollments ..con-tinue to increase." 

"None; there has' been complete college Goopercition and "support." 

"The recommenddtiqns Appeared impractical, a^t tfietime." 

1 ' ' . ^ : ' 1 

"None except time. Reviewing the written recommendations indl- 
'cates that all but one have been accomplished,- and that one is - 
being worked on."* , . • * ' 

^ "By board directive, the recommendations have been accomplished 
to a large degree. There was , 'howev'er,'" sonte' reluctance on the 
• - part of some administrators to give occupational, 'edi>cati on its 
rightfur place in the overall picture in regards' to decision . 
' making." , , i, ' ' . ^ ' ^ 

■ "Difficulties ha/e arisen in implementing better lines of 
responsibility" and authority because of oar change^from a •■ 

'single-campus district to a niul-t'i-campus district." , . ^ 

V • . ' • ■■ I •' } ■ - \ . , 

"Peopl\in" management roles tend to ignore the recommendations." 

"Actually tHekCOPES vi'sitjation .served to overcome our major 
difficulty. Ihredirected the thinking ot the administration, 

■ particularly thdse- who w^jre in a position'to do some1»ing. 
Most" -of wh^at -had been dorjb' was Ijp service. I feel that the , 
direct and spec/f ic recoii|iiendations of the' COPES committee, 
along^'th the/overall qijblity of the comnittee, have done 
more Wshape^the directibn'pf occupational education at this 
college thaof^ariy other influence .during the last ten years. 

We still have a long' -way to go, bu* for the first time we feel * 
we'have a di'rection and a. purpose.. This ,has done a great^^deal 



to restore -the confidence 
■ pride in" the job they ar^; 

Effects of COPES 

/ As'shown' in* Ta*b3j^s Vand 
(again excluding don't kt^ow ai^ 
substantially tn improvement, 6 
occupation-al education and in 



of the voc ed staff and givej)^ them 
doing ..\ 



\^ COPElwas^een bx thef^respotidents 
} no respons^) as having^^res.ul te4^^^ 

the qirality and availability of ^ 
i beneficialompact.ontstii^ ^ _ 



' • • o • ..Table "3 . ' , . : - 

•• . . • • • ' J- 

' COLLEGE RESPONSES REGARDING IMPACT OF COPES ^ 
.:0N IMPROViS^AlITY AND -AVAILABILITY OF OCCUPATIONAL EDUCAT 




Qifestio'n: Did COP£S improve. thfe .quality and availability of occudational 
education -at your college? _ . 

(N = 39.) 

)on't Know . 
or 

No " PerH^^s . 'Yes !( Somewhat)' Yes (Unqual'if ied) . No Response 

26 . • .3 . 



3" 



Source: Mjiiled respjDnse,^. 



' . - . ■ jabie 4 ' . • • 

''college Rfs>DNSES REGARDING IMPACT ON -STUDENTS ^ 
RESULTING FROM IMPLEMENTATION OF COPES RECOMMENDATIONS 



Question: ' What was the impact on. students "by imp.lenienting the. COPg.^ 
recommendations? , • ' ' > 



None 



' Very Little 
2 



(N = 39) 

• Beneficial in Areas 
of Jmplementation 

20 



Don't Know 
or 

No Response 
16- 



Source: Mai l ed* responses . 



Concerning student impact\ 20 of, these 23 respondents noted beneficial 
results, and 29 of S6 c'ited occWationaTeducatioi) iniprovements. 

Many of the -ef ficts were of\'a quite tangible rfature^ others involVed 
matters of "cljmate/.' KSee Appertdix 'C-3 Jl^ ^ • _ _ 

In rank order,. the 15 most fAequently^ mentioned areas of pgs4i:-tve^ • 
effect Were : ' * . . ' 



S 



•/ Strengthening of curriculum (i -e.',* course a-nd program addition's 
•and ilpdcLtings) ^ . 

i* Professional staff a,dditi'ons 

• 'Increased institutional' gwafej^ss and recognition of occupa- ^ 
' tional programs - ^ . . . , 

• Imprx^ved occupationaj staff morale* ^ / 

• * Improved .administration of occupational -education ^ 

Improved placement services 

* - ' . . . 

V Increased staff • awareness and support of occupational 

' ' «• ' * ' 

education needs ' • ^ 

• • . « *' . 

• Improved seryices for 'handicapped staderits ' 

\r . • * * . • ' • * • ' ^* ' 

-•^alidatioTi-and sup^port, through COPES, of college-identified^ 

' - ^ occupational . education needs' and priorities 

• Improved Student follow-up, laic^geiy^thptrgh implementation of\ 
\ SAM (Student Accountability, Model ) , 

Improved occupational counseling and guidance 

Improved work-experience programs. / • •^ 

Increased "professionalism'^* among occupational edtfeatiflin 
fficulty (e.g-, continuing interest ^n/dSSBSSjng^ content of 
their courses and instructional meth^ 

improved instryctional facili\ties^;/ 

Increased enrollments in occupationalT programs. 
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; In all., 139 positive effects were- noteil. -'.^On' th'e^ other ^-harid,, six 
mentions were made of negative- effects- -mostly in connection with". the 
f'e^pondents ' bel ief that some 'COPES team«*m.ember^ 'came i^D' tfg^^col I ege's 
w\th preconceived opinions or' that they« tried 'to "sefV" .th^ir own ideas 
to. the' college's. . ' . 4 . • 



- Some typical respondent comments (see Appepdix C*^, relating to 



tthe questions; of Student impact, ."occupati onal ^education'«^>:ovement, 
and 3ther effects of -COPES are presented' immediately below's'i^, : , ' ' ' 

^Impact .on Students . * * * / . " ^ 3^ ^ 

' ^ . , r % , * ^ 

"CbPCS said needed^ outrea.c1i locations. At the time- We had . , 
/hone. Now we have ten. -Thus there-are more classes availaWfe ,^ 
' to students away from the campus. We, also have moved to sTc^ve ' ^ 
•our .campus facilities problem by^addin'^ a mul ti-mit1.i6n-do>lar 
building*, in^*add4tion to many 'portables -^^ ' 

'^K growing enrollment figures in the oCcupatlonai^ program^ Brel * 
an, indication, the impact mustJ^e positive.<^*This could result- 
- from our becoming more aware^.of student needs and making pro-" • 
« ' grams more. .convenient for them/" ^ ^ 

^'Too eariy to tell, but Tdoubt that any ii^pact will be^felt - 

.by studentsrr**- ^ - - ■ . >^ ' ^ 

•*The' impact of COPES recommendations oh studentsV has bpen 
greatest: in the areas of 'placemerrt, fql Vcai--up, and work . \ 
. experience. We now have -staff irig and a system that did not ^ 
- * ^ exist Jwhen COPES^ was ^here for a visit.* Jji adclition, many^ 
' 'areas of vocational education have- been updated At\ facilities 
a.Ad equipment which results in better cof^ditio.ns^ /or -'student • 

l-earning." * - . 

• ; • ^ . * . ^> .f . 

' "A major effort of occupational staff in developing a 'progiram . 
evaluation process -will undoubtedly prove to. have a major Impact 
on program qual4ty 9nd thus on- student success* in the wor]ci .of 

; wo*k,-*' . ^ ' _ ^ * *\'<^ " 

"We have /nore individual iz-ed instruction, now, But this is'not \ . 
^' X a diYect result' 5f COPtS.- The COPES p^ofire, .howeVer^^ was one' ^ 
^ of- many reasons for our efforts.'' . - > . ' 

"The communication-^etween the occupational education faGyjty.^. '. 
and the counseling cfepartm.ent has increase^l greatly. Jhis has 
provided^students with more upr-to-dat'e~ counseling information,.'^ ^ 



Inipi:;gvenient$ in Occu0ationarEducation Quality^and Availability 

"COPES* made. us Sware of the need >to become moire Icommiiioity-oriented 
to' analyze community needs, and %o engage jn -stu^^nt recruitment. 
Our ef.forts in th^se regards have proved to* be vdQ' successful . -» 
During 1974-75, for'example, a- major student recruitment effort 
ms put forth; it realized a better than 25% growth,"' 

"Course' outl ines -have been examined and updated as per COPES' ' ' 
suggestion."' ' ' , ■ 

"I don't think so. -We have good programs and .knew they were good 
long before COPES visited us." 



"The board and put)lic became tnore eware xlue'to 'the team. visits-, 
♦'and reports; thus more support was generated.", ^ ^ 

-« • ' • 

"Because of t^ needed .admjni§trative,Vupport and r^ognition^ 

there 'is ndw^ah associate dean for variational education, who jhas* 
"the responsibility and authority in reg^iicd to program planning, . 

budgeting, and scheduling which has made many of the needed ' 

changes possible," [ ' 

"Increased use of advisory committees; Faculty' load study 'and 
new policy. Counselors ar<e now- assigned to advisory. Goirtnjt tees 
to assist in understanding programs and opportunities** > Learning 
paekets, tutor's, and career center have been' initiated." " 



."Many of the improvemeotS were in the planning stages and would 
have'^aken place anyway— COPES "or .no COPES. On the ^ther* hand, 
thtf'CORES report helped support and pin^nt our needs, and may 
have ^been a contributing factor to our obtaining the improvements 
needed . " . ' . " ^ 

"COPES facilitated the es-tabllshment of a 4)Tacement office -and " ' 
upgrading gf the follow-up process. It aJsoj|S'timulated intierest 
in development of a program evaluation mode rand in producing 
meaningful job m?trket analysis studies." 

Other Effects 

"TJie effect*-^f ,.the COPES. visitat4on were pomive, making many^ 
»oji campus aware of facets of our occupational program that others- 
wise would have remained obscure and unidentified. 1 believe the, 
.$otal staff saw a dimension to, the, program ^hich^they^ had riot 
prg^ously conceived or thought significant." ^' f 

"The^cal legs' is in the process of organizataonal res'lrucduring. 
' Therpresident,.. having been involved in the COPES evaluauon, 
has become sensitive to occupVwional programs in relation ta^' • 
cqpufiity needs. He has, in the reorganizitional process, taken. 



.♦cerfain reconimendati6ns m^de by iine COP£S team and hks implemented- 



these concepts J n the restnuctu 



^'Many faclil ty.fel t^they were befih^interviewed ,by peolple 'sftnijig' 
their own-thin^. " * 

"Having -outside represent-^tl^ves with expertise in the ocgupational 
areas 1ea± credibility to tl;ie/ ^tudy, " , ' 

r ^ ' • : ^ 

"Bosjt, of the effect has bWn/Vn terms of purpose or phiTosiJphy. I 
don*'! want you to assurhe t/iac/all occupational education staff 
; are standing shoulder to shoulder,. •but 90% o f our, people have'come 
alive and are involved, jr^paps you might say they ar-e becoming 
more ^professional 

"Staff .became more aware' df. criteria for evaluating the quality 
of. Qccupational edu/"'^'^^-" — " 



jroqrams . : 



V^^l/dati( 



/ 



0^ College RespQOses 



VaVidation .visits [to 



of the cooperating cbTleges largelycon- 
firmed the^colleges"^ j^lritp^jfr rjeapbnses. (See Appendix C-5.) 

or -fifldings wer'e that there were overstate- 
other caaes' understatement^,.- For example, 
va-lidation did not confirm the written' . . 



In^^^ome case's, 
jnents by^the^ r^spon 
in the two instant^ 
responses on studep 
oril^ college a^icTgrj 
thing^ occurred reg 
confirm the r^spohj 

As *^a: matter ' 
edacdtjon improy 
been j^oted by th 



ft 



Hidf^l 
htsk /ii 



wh?r)E 

mpict, it appeared to be less than reported at 

iteir cljan r^epprted at t+)e^other. Exactly the saftie 

ill ^ t " * 

'di/nq the two instances where va-lida'tion did not' 
es/o/1 other effects resulting from the COPES visit. 

the validators found T6 ^reas of Qccupatjonal 
gnt /creditably at least in part to COPES which had not 
iondents. (See Appendix C-6.) 



Included a(mong/ validator cfomment.s (see Appendix C-7) in reporting 



OR their visits 

^'Eighteen /of 
> . surprising /r 



o/tlne colleges 'were the following ' 

ye' 22 ^people I interviewed at th'e college held 
'call of the -COPES t^am visit four -years ago. All 



18 were kraw/|^^ critical needs. The pVesident was 

most posift'ivt ;and proceeded to list the cpllege responses to 
the needsj ;/lri my judgment, nine of the 11 bave received • 
attentip^i?' / .> ' ' ' , * . . ^ 



"One thing that came through i1i today's interviews was the- credit 
given the whole' COPES p^ocess for mot^'Vating and Stimulating staff 
'to^ reflect on what is and what ought to be. A number. Volunteered 
the belief that the COPES approach i^r superior to accreditatj^n as 



process.' 



"The COPES . process was very prominent in moving the -cdllege to 
moblljze for action. It was a very posittve direction.". «. 



• ■ COPES SYSTEM AS'SESSMENT AND RESULTANT ACTIONS 

, .College Responses 

College respondents offered a variety of suggestions for increasing 
the impact of COPES. (See Appqndix D-1 . ) .. - . ' ^' 

In rank order, the five most frequently mentioned areas for action 
were: * - - ^ 

• Make regular follow-up revisit provision for determining extent 
of colleges' implementation of COPES recommendations,. , 

• Provide consultation to colleges on impl orientation of 
recommendations. [ * ' . 

• Be more specific in r.ecoinmendations. " " . , .^.-^ 

• Improve in-service training l^or COPES team' members regarding 
visitation purpose (to minimize preconceptions and '"gelling" 
of * fuembers*' "pet ideas")'. . / ' - ^ 

• .Involve academic faculty of cooperating colleges in COPES 
process. - . ' ' ~ ' . 

At five colleges, the respondents rated COPES souhd ihMts present 
form and stated np further improvements are needed. M/)ne college, 
the respphdent questioned the need' for further deyejopment* of C^PES 
in view of existing techniques for institutional self-evaluation 
and provisions for accreditation/ , - ^ \ *. 

Typical among the respondents* comments, (.see Appendix D-2) were the 

^following: , ' ' , , J^^^^ 

*^"A regular procedure of having a fol Idw-upr visi t to the^ campus 
by perhaps one member of the original team is needed. 'He should 
, focus on COPES recommendation:^ and document in 9 written 'report 
\ those that have.beenVimplemented. " • . * ' , 

* '"^''None, unless it were feasible to rh^r an^ expert to the college 
who could suggest ways df meeting the recommendations/' 



"It would be well if COPES could be integrated with the total 
accreditation prbcess. It is difficult for a college to,, gear ^ 
up for separate evciluations." 

"VJhen areas of weaRness which deserve specific recommendations are 
found, these areas should be given greater .emphasis'^ and specific, 
detailed justification nn both written an(;J oral reports." 

"I believe COPES' impact is being, felt; throughout the state. 
Site visit chairpersons ar^ becoming more cognizant of their need 
to know something about. the college, i'ts particular role in the 
community, and its objectives. Perhaps more in-service training 
is 'needed for other team members so as to make them more fully 
aware of the COPES function in visitation." . 

"Visitors should come with fewer preconceived notions and mor% 
cur-rent understanding of the world of occupational educatiibrt. . ' 

"Develop techniques to infornf and involve non-occupational 
facul ty-- sel 1 the program b" 



Validator Perceptions 

College respondent suggestions were underscored by the members of 
thje COPES Revision Committee who conducted th^ validation visits. 
(See Appendix D-3.) * \^ 

' Concerning the oral' and written team reports, the validators' 
most frequently mentioned suggestion: Be more spec-ific. 

For the oral report, they also recommended principally en- 
couraging attendance of more college personnel,, including academic_^ 
faculty; fof* the written report;, wider distributiop^-including 
certain appendixes of particular import (e.g., student^and advisory 
committee inputs).' ,,' . • .^l^- 

Aside from the Jreporting considerations, there were ttiese 
comments (also-see Append i x. D-4): 



"There could be a regular pattern of follow-up at the participa- 
ting colleges two or three< years 'latere with a formal report on 
implementation of recommendations." 

Academic people should be aware of and participate in the process, 
".Yearly' revi si tation as a prod to accjomplishment." 



"Most interviewees focused on the time limitations of the COPES • 
team^'Visit and the unfulfilled expectations that many on the 
faculty had of meeting with.members of the team. Suggestions 
made included extending the length of the site visit and making ^ 
certain that those who participate in a study of this type^are 
afforded, the opportunity of interviews." * • > • 

"Once an overall evaluation has been done^ a follow-up- should be 
made with an in-depth eva»luation of specific occupational areas. 
Or staff should be *in-serViced to conduct their own evaluation; 
the college could*finance a team of peers to validate the / 
evaluation.'" . ^' 

"Dissemination of COPES* o'verall rep.orts on status of occupational 
e'ducation and subsystems should be expanded to include state 
legislators, college pres.idents, the Postsecpndary Comraission, 
the Board of Governors, and the State Advisory Council on 
Vocational Education. The i^olitical clout of these groups ' ; 
necessitates keeping them informed on COPES. They should con- , 
sistentlyreceive CpPES informational brochures, as well."- 



. ^ ' Subcommittee Recommendations 

The subcommittee assigned responsibility for proposing refinements 
in COPES system procedures and instr<imentation made three major . 
recommendations to the Revision Committee. These recommenrfations; 
based on suggestions* from participants In the assessment study and , ' 
from college feedback and COf?ES team debriefings in 19^4-75. and^ 
1975-76, involved: 

• Providing for follow-up determination of institutional action* 
taken as a result of COPES ^findings at all cooperating • 
colleges., ' * . 

• Re^ucj^n^.the jumber af evaluation items in_tne s^^stem*^;. r 
detailed perceptions Instrunjents from 60 to 36. \ 

• Simplifying the'factual-data part of the' instrument whidh 

represents^the official college view:of its Occupational 

e{liication system. ,^ .1 ' ^ ^ 

• - • . 

Procedures * ' ' f?' _ r * ^ ^ 

In connection with the^first recomrffendation cited abovfe, the sub- 
conmlttee recommended insertion of the following ift the COPES Guide: 
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After appropriate intervals or time J COPES will request fe^dbaek 
from the co^llege on^action taken as ^ result of the self-study^. 
' Such request for feedback may, includ,^ a one-day revisit to the 
college by a knowledgeable (^PES professional." 

The committee also recommended numerous otl^y!.^ Guide changes, ir)- 
cluding--as often su-ggestfed in'^ feedback^anJ debriefings-^addition of a 
counselor to a typically composed COPES vali4ati6n team. 

I-nstrumentation * - -iA 

" The detailed perceptij)ns instruments' 60 items were reduced to 36. 
The process involved cpnsolidatihg duplicative or- overlapping considera- 
tions. Also items more readily -measurable in terms of other items than 
by themselves were eliminated (e.g., "adm^inistrat^on's commitment to , 
occupational educatiqn_^' jcdn. better be determined by such factors as 
budgetary provistons and effective organizatiqinar structure than as 
an jsolateU.concept)< - ■• \ ' 

* Ivi connection with the third recoimiend3tion ^clted above, factual-, 
data'.^reas of^the Instrument representing- the official college viay/ 
were, revised. Items which had been found' througlr'experience not to 
be^ critical" to the" conduct of effective. evaluation were^ eliminated, 
AVso, whferever possible, critical areas were .simpl if ied so as 'to 
minlmtze collegi? efforts in responding* 

' Jhroughout the tletailed perceptions instruments, items and criteria 
were reworked as necessary for greater ^clarity and precision, ^ ^ 

Revision Committee Decisions' 

Having reviewed all pertinent inputs, members of the C^PES Revision 
Conwittee at their year-end meeting decided that:- ; . ^^^^ 

• The, present COPES system is fundamentally* sound. 

• With some modifications suggested by* committee members, the 
chan.ges recommend'ed by the subcommittee should be made in 
^procedfires and instrumentation, ' « ^ ' 



Suggestions should be made to a college on how its self-study 
wjjitten. report might be^di.s^tri bated to provide an optimum 
basis for action. ' ' \ ^ ^ , 

The personal COPES revisit to a college one or two years , 
' '' • ^ 

"following its self-study .should become .standard procedure. 



i 



4^esultant Actions by COPES Management 



«0n the basis of the Revision Committee decisions and other^acefeS 
of the study,* COPES management approved the following actions: 

• Installation a:s standard COPES' procedure of a personal revisit 

• to each cooperating college one or two years after self-study 

» ^ " ^ ' • - 

to,detennine" extetit of implementation of recommendatioris. 

> ' '^-f ' - ' . I • 

• Publicatrton- of-simpTifieci and otherwise refined/detailed 
instruments, including reworded evaluation iten/s and criteria 

' ' - for greater clarity^ and precisicfh*. 

-^^ • Greater specificity and sharper focus in oral /and written^ 

reporting by COPES validation teams through a process in which - 
perceived ^areas of strength and of priority needs for improve- 
ment;will be ranjc-ordered for each cooperati/ng college, and will 
. be linked directly to items shown on the derailed instruments. 

• Undertaking identification of exemplary programs and practices 
at cooperating colleges and securing of appropriate metnanisms 
for making them known t& other colleges interested in occupa- 
tional education improvements. . ^* . ^ - 

. i Enlisting the future participation, of counselors on COPES 
validation teams. . . ^ 

• Deve.lopjnent of procedures for *considerati6r\ by cooperating 
. ' ' « / , 

colleges in achieving* optimum distribution x)f the validation 

. team*yrittea reports and obtaining their most effective-lise . 

* as a. basis- for- planning institutional action. . 
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COOPERATING COLLEGES REVISITED^' 

College Coordinator 
of Revisit 



Revision Committee 
Revisit Member 



Barstow College 
Barstow 

Apfil 26,^1976' 



William J. Krue^r 
Dean of Instructional 
Services 



George W. Ebey 



Cabrillo College 
Aptos 

May 5, 1976 . 

College Qf the 

Canyons 
Valencia 
April 8, 1976 



Cerritos Ctfi^egfe^ 
Norwalk ' ' 
April. 19, 1976 



Cha^ey College 
Alter Loma 
May'4, 1976 . 



Jack Snyder 
Ctean, Occupational & 
Continuing Education 



Ro^rt G. Pollock 
Dean,' Vocational - ' ■ 
■<f Technical Education 



Richard E. Whiteman 
Dean ^of Vocational 
• , Education 

Ralph A. Porter ' 1 
Dean, Occupational 
Education 



^illiam R. Morris 



David v.. Robles- 




Ray E. Loehr* 



M, Jack Fujimoto 



Jresno City College 
Vresno 

April' 20, 1976 



Richard H. Handley 
Assoc- Dean of Instruction,, 
Occupational Education 



Imperial Valley Co-lTege. Wflliam D. Rudolph, 
Imperial * ' DeSn of Vocational 

Apfil 23, 1976 * ^ Education 



Irvin Colt 



■ ■ f. 

6e(^ge W. Ebey 



L^r's Angeled Pierce 

College 
Woodland Hills 
Aprif?, 1976 ^ V 



M. -Jack: Fujimoto , 
Dean of Instruction 



David V, RobTes- ' 



\y Completed questionnaire and wetierevisited by member of COPES Revision 
Committee. • * ' 



College* of Marin 
•Kentfield" 
May 3", 1976 



Palomar College 
San Marcos 
April 23, 1976 " 



JoseoH-E. Bferruezo ' ' 
As.st! Dean of Instruction - 
• a-nd >Dlrector-, " Vocati onal- 
Technical Educatton ' ■ 



Wal ter F/ L. Brown 
Dean, Occupational 
Education 



Nathan H. Boortz 



Henry ^.Xh^^d^^r^ 



4 



Portervllle College. 
Porterville * 
April 22, 1976- 



College of the ^ ^ 

Redwoods 
Eureka^ - 

ApriJ '22, 1976 ^ 

0 • 

Rio ftondo .Colleg'e-: > 
Whittier 

April 30, 1976' , 



Edward Buckles 
Associate Dean-Vocati 
"Technical Education 



(/nal^ 



"ET W. Soper , . 
Dean, Occupational - 1 
Education . ' 



Vfi lbur ^iorbeer 
Dean, Occupational / 
Education """"^^ 



Glen-R, Guldberg 
Tarqn Reeves 

Jack Snyder 



Sacramento City 
• 'College 

Sacramento 
April €6, 1976 



Louis Johnson 
Associate Dean of 
-'-Occifpational Education 



Thomas M, Bagetich 



, Santa Barbara' City 

College 
*^nta Barbara, 
Ma> 7, 1976 



' Sojjthwes^'ern College 
Chula Vista 



April 26, 1976 



^Melyin J. Ellcins . ' • 
Assistant bean. Career 

and Occupationa^l . 

Education 



Jhomas Hahn 
Dean of Applied Arts 
and Sciences ^ 



Jack $nyder 



e^en :Ri Gujdberg - 



Victor Valley 

Community Co 11 eg ^- 
Victorville 
April 9/ 1976 



Charles Peterson 
Assistaat Dean, Occupa- 
tional Education 



Henry E\ Childs, Jr, 



West' Van ey Col lege 
Saratoga - ' 
April 23, i:976 



Philip DeMarco - 
Dean Occupational 
Edu^ion 
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M. Jack Fujimoto 
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OTHER CO0PERAIIilS_4pLLEGES.4 



1/ 



« 9 

Col lege -and Respondent 



College of Alam^a 
Alameda * ' 
Edna] P. Froehlich, 
Goordinatdrlof Occupatior _ 
Education's Woperative Educa^feior) 

" AmerTban River College, 
Sacramento 

Louis Quint ^; * • ^ 

Assi-slant Dean 

Occupational Education . , . 

Craf ton Hi 1 1 s ^Co] lege ' 
Yucaipa' ' 
Edward. L. Chapin,- Jr. 
Dean, Evening ^ Summer, and 
Occupationajl Education 

Cypress College ^ 
Cypress ' \. ' r ? 
Lyndon E/ Taylor 
Administrative Dean^, » 
Instruction • ' 

*De Anza College 
Cupertino 
' Richard B. Kent 
^Associate Dean of Instruction 

'College of the Desert 

Palm Des^ert - 

James T. Pull i am 

Coordinator of Vocational 
, Education 

Glendale College 
Glendale 
Thomas S. Ryan 

Dfeari of Occupational Education 



Merced College 
Merced \ . ^ - ' 

W. C. Martineson? , 
Dean of Instruction . 
Vbctitional •'£d^.ca*tiGn ' 

Orange Coast- Col Vege 
Costa Mesa ' ■ - ^" 

^Jadc Scott . • . ; 
Dean of Instruction. 

Riverside City College 
^ Riverside. 
Cecil 'D. GreeiT^ * . ^ . ^ 
Assoc. Dean of Academic "Services^ 
Occupational Education*. [ ^ 

San Diego City College 
^San Diego 

James E^ Hilsgen ^ 
^ Dean of Vocational Education 

San Jose City Collet 
San Jose ^ \ ' / 

Lois A. Callahan . \ ^ 

Dean of Instructton, Occupational 
•Education 

Saata Ana CoTl-ege 
'Santa Anar 
Fred E'. . Ittner • 
Dean, Occupational ^Education ^ 

Santa Monica College 
Santa Moni.ca ^ ^ ^ , * 
Herbert L. Schlackman « . 
Dean of Occupational Educatitonf 



Sierra^'College ^ . * 

Rocklln 

Martin E. Jack, Jr-. 
Assoc. Dean o,f Instructioh 7^r 
^ Vocational Education . 

y Cqinplgted questionnaire but not , re visited. . • 



Los Angeles City College 
Los Angeles 
^ James L. Heinselman 
Dean of Instruction . 



* Solano Community College 
SutsunTlty - 
Gerald M. Simoni 

Director of Vocational Education 

.Taft College 
.Taft 

-"Wendell Reeder 
Superintendent/President 

' Centura 'College ^ ' ^ * ' 
Ventura \ ^ * 
Charles C. Dahl- 
Assoi^. Deah^ of Instruction/ 
-'"Career Education ^ - 



West Hills College 
Coalinga 

Daniel R. Peterson 
Dean of Instruction 

Yuba 'Coll ege 
MarysvilTe ^ : 
Earl B: Orum ' 
Dean of Instruction 
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^ COPES PROJECT PARTICIPANTS ' • , 

Revision Committee . - - " / 

Thomas. BogetiCh, Executive Directpr^ Cal ifornia' Advisory Council on ; 
\ Vocational Education and technical Tiraining ' - 

• * > ' y 

Nathan H. Boortz, Director, Technical Education, Foothill -De Anza^Communitj|'' - 
y-€©nege District ' ^ ^ v / 

Henry E. Chi.lds, Jr., V-ice President for Instruction, Chaf fey College h ' 
/ Irvin Colt, D^'rector, Occupational Education, Mt. San Antonio College. 
: George W. £bey. Project Coordinator, COPES Service Center ^ 

M. Jack Fujimoto, Dean Of Instruction, Los Angeles Pierce College / 
. Glen R. Guldberg, Dean, Vocational Education, Citrus College / 



* Ray E, Loehr, Superintendent, Ventura County Community College District 



William R^'Morris, Evaluatipn Specialist, ''Chancellor's Office, California 
Commun«ity Colleges \* - r . / 



T^ron N. Reeves ,' Associate Governmental Prbgram Analyst, Chancellor's 
Office, Cal ifornia' Commun-ity Colleges^ ■ ' . - 

David V. Robles, Deputy Director, E^onom^ic & SociaiTOpportunities /Irfc. 

Jack Snyder, Dean, Occupatioh<l^ Continuin^^ Education, Cabrillo College 




Revision Subcommittee ' ' 

■ ' • • / V. 

jQhn L. Bullerv-Vrce Changellor-Vocational Education, Coast Commumty 
I Cbllege Distr^t , . ,/ ' • • ' 

Arthur N.' Che,^ack, Director, Edutational Research and Analysis, .L(Js, 
• Ancjeljes Community College District 

George W.* Ebey, Project Coordinator, COPES Service Cenl^er ^ 

. ' . ■ • . ^' 

Raymond E. Hernandez, Specialist, Occupational Education, Chancellor's 
'Office, California Community Colleges 
■ <, • ^ . 

John M. Hubbard, Assistant to Chancellor for Community Relations, San Mateo 
Conmunity Col lege .District ' '. .> , ' . 

Richard B. Kent, Associate Dean of Instruction, De Anza Co^llege ' 



Tlanning ?nd Internal Evaluation Committee , , - ' V 

- / ■ " 

Joseph E. Berrue^o, Assistant Dean of Instruction, Vqcational -Technical 
.Education, Cdllege'of Marin; Past President, CaUforfiia Comnkinity. College 
Administrators' of Occu^jational Education • / - ■ . 

.Nathan H. Boortz, Director of Technical Educatiopf, Foothi 11 -De Anza • 
CommDnity College District; COPES Project Manager • • ' 



Dale L.v Bra tteji,' Dean of Instruction, Columbii Junior College; Past 
Chairmark 'Northern Calffarjii a Deans of Instruction, 

Henry B. Childs, Jr., Vice President for I'nstructio-n, Chaffey College;'. 
-Past Chairmari, Southern California Deans/of Instruction V 

' ■ , / 

John^ W. Dunn, Chancellor, Foothill -De inza Coirmunity College DistVict; 
pVes-ident, Association of California Corraiiunity C9l lege Chief Adminis- 
trator's " ' . ' • ' ' 



George'*l3,,Ebey; "Project Coordinator, COPES. Service Center^- " ^ 

Raymond- E. 'Hernandez, Specialist, Occupational Education, Chancellor's^ 
Office, California Community Colleges 

Williaijn R. Morris, Evaluation Specialist, 'Division df Occupational Edu- 
cation, Chancellor's Office, Californ-ia Community /Col leges 

Ernest R. Neasham,' Evaluation Consultant,,^dTvis(on of Vocationa'T Educa- 
tion, Cal if orni a Stat'e Department of Educatlw ' . * ^ 

Richard E. Whitemari, Dean,' Vocational Education, Cerritos College; , 
President*, California Community College Administrators of Occupational 
Education ^ '/ 



C-1 DistRiBUTioi^ OP- COPES Written Reports 
' AT Cooperating Colleges 

'C»'2 Obstacles to Implementing COPES Recommendations 
„ College ' Respondent Percept i ons^ ' 

C-3 'Effects ofVCOPES - College -Respondent 
\ • Perceptions . • 

C-4 Comments of College Respondents 

C-5 - CoNE: I RMATroN ^6f College Responses , 
^Validator F I nd'ings^:.^ . . ' 

i^--6 Additional Coclege Improvements Creditable 
TO COPES - Validator Fundings • . ' 

C-7 . Validator Comments ' . . 




« 



Appendix C-> 

DISTRIBUTION OF COPES WRITTEN REPORTS 
AT COOPERATING COLLEGES 



Qu«stion:"n^o whom was thfe COPES written report distributed? 



Recipient Category . 



All administrators 
Occijpattonal Vacuity 
Counisejors ^ 
Advisory cormnttee members 



V. 



Board members 

Students . ■ " . 

IW - Some administrators 

ATI certificated personnel 

' Available to all, and widely discussed, but not 
distributed en masse 

Discussed at various meetings, buF'no't, d^istributed 
Division chairmen 



' Mentions 
(N. = 39) 

36 

33 

19 ' 
^9 

6 M 

3 

2" 
1 

" 1 . 



^\irce: Mailed responses. 
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^ Appendix C-2 ; 

OBSTACLES^ -IMPLEMENTING COPES RECOMMENDATIONS 
- . COLLEGE RESPONDENT PERCEPTIONS 



'^Cfue^tion; What difficulties were encountered in implementing the COPES 
recommendations? Please explain. 



s 

Area of Difficulty 

Insufficienjt fund^ * . ' 

Time * . ' ^ ' . 

Unresolved college management "role in multi- 

college district * I 

Resistance to assigning"* more decision-making 
responsibility to occupational education administrator 

Administrattve organization changes 



Apparent impractical ity of recommendations 
- individual .faculty problems in implementing follow-up 
Plafining problems, 

Reconmendations tOD general for easy implementat4on ~ 
Resistance to change on part of academic-oriented faculty 
Staff disagreements as to implementation priorities 
Strained board/administration/facuT^ relationships 
Tendency of -management to ignore r^ommendations- 



Mentions . 
(N = 3^)* 

12* 

7 ' 



2 " 



( ■ 



*Fove respondents stated their colleges had "encountered no difficulties 
of material importance. Re^ponjes to this question were not macle at 
two colleges'.. ' ' o ^ / ^ 



'■^Source: - Mailed responses, 
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^ Appendix C-3 

EFFECTS OF. COPES . ' 
^(IMPACTS ON STUDENTS, IMPROVEMENTS IN QUAblTY AND 
AVAILABiLITY OF OCCUPAIIONAL EDUCATION, OTHER) 

• ■ . . ' ' • f 

. COLLEGE RESPONDENT PERCERTIONS . . ' 

\ . • 

Questions:"' What was the impart on students by implementing the COPES 
recojtmendatipnsT^id COPES, 'improve the Quality and avail- 
ability of occupatijMial education at your college? Were 
there an^* other effect (positive or negative)- resulting 
from- the COPES visit? Please explain. . - 

Area of Positive Effect . . ' Mentions 
^ ~ ^. : *'* - .{N = 39) 

Strengthening of curriculum (i.e., coyrse ^ind progra'm , , 

additions and updatings) - / ■ 10 ' ' 

Increased institutional awareness and recognition 

of tts occupational programs . ^^^^^-^.s^v^ 

Professional staff additions * • . - 9 

Improved occupational staff itiorale ' ' . ; 8 

Improved administration_pf occupational education ^ \- 1' 

Improved placement, services * ' / • ^ ' \ 7 

Increased staff aVfareness and support of 

occupational educatian^'needs ^ ^ 7 

Improved' services for handicapped students . ^ 

VHlidatlori and support, through COPES, of college-identif:ied 
occupational education needs and priorities / " ^6 

Ifliproved occupational counsel ing^and guidance * . 5 

Itnp^oved student follow-up - ' ' - 5 

Improved work experience programs ^ • • \ ^' ^> 

• Increased "professionalism" among occupational faculty 
(e..g,, continuing intef^^in assessing content of^their 
courses and ins^tructionaPiethods) ' ' ..5 

-Improved instructional facilities 4 



• "-^ Y> 4k k» 



. Area of. Positive Effect (continued)'- 



♦Increased ehrollments- in occupational programs 

6r6'ater emphasis ^on- outreach programs 

Irnproved 'inStructicfnaT equipment 
.Improved internal communications • . 
* Improved use of advisory committees . ^ • . ' 

""New e*mphjasi5 on job market analysis , ^ 

-Piraprofessional staff aBditions 
- Improved ^planning processes ^ 

Improved services for disadvantaged students ' 

Increased goverijjng board and public awarepess and 
support of colleges occupational programs * • • 

I>Qcmased use of individualized instruction 

'New emphas^is on-x^ommunity needs analysis - 

*'t)pp&htunity'afforded by COPES to share ideas with . 
^ ^team members * . . 

i ' - > 

.Development -of college policy on faculty load 

'Development of institutional program evaluation process 

Good feeling on pact of occupational faculty regarding 
credibility of COPES findings -because of expertise 
demonstrated by team members " • - 

^ood feeling on part of occupational students regarding 
their opportunity"" to. pro'vide input to" theJCOPES study 

Implementation of . evaluation process fojr part-time- 
occupational faculty ' 

Improved budgetary provisions for occupational education 

Tmp^oveffltudent confidjence in programs as result of 
COPES findings - ' • 

"Increased provision, of remedial ass-isfance to 
occupational students in mathemati-cs and' English 



♦ 



» ,9. ^ * • 

Increased use of short'courses ' 

Interest demonstrated by^ occupational ♦faculty 
'applying COPES again in the future. 

^ More effective use of resources , 

J^ew effttphas^i^' on recruitment of. students into 
occupational programs 

< 4 

Area of Negative Effect ' 

Feeling that some COPES team rnembers had 
preconceived opinions 

Feeling that' some COPES team members tried to 
'•sell" their own' ideas 

# » 

Bad reaction on part of soffi6 college personnel 
regarding diversion of resources to enable Candtfct 
of COPES application * i • • . 

f ■ - - ' ^- ' • . V ^' :j ,^ ■ 

Feeling on part of some occupational ;f acuity that ^ 
occu^lfational programs ar,e pver-T^ Tubject to evaluat'^ion 
in comparison wftTri[ca3emi<i ^prbg ; 



Source : Mai 1 ed responses 



Appendix C-4 

' * ^ COMMENTS OF COLLEGE RESPONDENTS 

. * Among the questigns directed to college respondents were the 
following: , . 

• What difficulties were encbunWed in implementing the.- 

* 6 

CORES recomrtiendations? . * ' , . 

' What Ws the impact, on students by implementing thetCOPES 
~ recommendations? 

Did COPES implfove the quaTtty and availabili^ 
. occupational education at your college? ■ 

• Were there any other effects .(positive or negative) 
resulting from the COPES visit?. )' 

wiiTle content analyses of the written responses, are provided in 
Appendixes C-2 and-^C-V, selected verbatim replies 'are shown below 
for readers who wish further details v . _ ^ 




What. difficulties were encountered in implementing the COPES 
recQmmepidations? , . - . 

"Needed staff could not be hjred- because' of district restrictions 
on hiring, and money was not available for needed equipment and 
added sections in certain areas. In spite ipf the above li mi ta.- 
t.ions, our enrollments contijiue to increase." 

"Immediate implementation was -difficult due to the board/ 
admini strati on/facu]ty relationship. .However, -si nee the ■ 
hiring of a hew superintenderjt/president, considerably progress 
' . has been made." ' . " 

"None; the^e-has been complete college cooperation and support." 

"None except time. Revie^ng «ie written, redommendatians indi-. 
. cates that all but one hd^e b^n accomplished,. and that one is , 
J ^ V,^- ^-i • being worked ori./'" . ' e 

"Follow-up studies continue to create a probl em Jor . individual- 
' faculty, yik introduction of the SAM procedures. Will aid in this 
problem." , . ■ 



fERIC ^ 
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•'"None; ail rectDmmenda.tions were^accepted- as i.nstitutionaK 
objectives for improvement of occupational education during 
. 1975-76."" ' ' , ° 

■ "This college. is very academically oriented', and most instructors 
refuse to chanA; Bven the occupational instructors, tend to 
instruct for tht transfer student." 

- "Clarification of management roles has been»> particularly diffi- 
^cujt in this mul^ti-campus district. Each year since the COPES 
. visit this function has improved." . . 

"By board directive, the recommendation's . have been accomplished 
to a Targe degree. There. was, however, some reluctance on the 
part of , some administratof^s to give occupational education its 

• rightful place in the overall picture in regards to decision . 
making""* • * ; * ' ! . 

» 

"Our biggest obstaclen's a hard-headed business manager." ' , 

•s " 

"iC^ctually.the COPES visitation served, to overcome our major 
difficulty. It redirected the thinking of the administration, ' 
particularly those, who, were in a position to do something.- Most 
^f yvhat had been done was token .lip service- I feel that the . ' ' 
difecfand specific recommendations of the .COPES committee., .along 
with'tbe overall 'quality of the committee, have done more to . 
-i'Shape the d.irection of .occupational, education at.this cpllftge 
than any other influence during "the last 10 years. We still . i .. 
have a long way to go, but for the. first time we feel we have 
a'diredtion and a purpose." .This has.<lon6 a great>dejl-to.jnestore- r.. 
•the confidence of the voc, ed staff .and* given- thenn prwe in -the ' 
job' they are do'ing." , . 

■ ' • » ■ » ■ " . 

"The recopnendat ions, were too general to be easy to implement." 

, "People in mariaigement roles' tend to ignorg^ the recommendation?. 

* .■"The, recommendations -appeared impracticaV at the, time." 

• * . ♦ ^ ' * * 

■'>f.Difficaltfes',have arisen in- implement=ing better lines of responsi- 
-tritty and .authority because of our change from a single-campus 
district to* a multi-campus district." 

Vlhatwas the impact on students by implementi-nq the COPES recommendation? 

"COPES' said we needed outreach locations. At the time^we had none. 
-Now we have'^io: Thus there-are more classes "Available to students 
away from the campus. We also have ^^lbved to solve our *campus -~ 

• , facilities problem by adding a multi-mil Ifpn-dql.lar. jjuildinj, in 

addition to many portabT^s^" • ~ ' " 



"If growing enroninen;t figures in the occupational programs are - 
Mn indication^ the impact njust be positive. . This could result , 
' from our becoming more aware of student needs^and making programs; 

more convenient for them.".,. 

"Students. enjoy, a career center and improved career counseling." 

■ "loo .early to .telh but J doubt that any impact. will be felt by 
students." ' . " , . , 

'"^ery little, in that most COPES recommendations wefe not ' 
implemented." , \ • 

• COPES recommendations concerning the development and- improvement 
of work experience, evaluation of part-time facultyVand expanded ^ 
use of short courses have had ver^^^' positive resjilts for the, W 
students." * ' . S 

"Tha impact w^i^ ori administration.", 

"The\COPES Study resulted in improved student confidence in the* 
progcams, because improvements were made to better prepare , ^ 
students for employment. This increased student motiv,afi,on and , 
...purpose for attending school." • . 

"The fmpact of COPES recommendations. on students has been greatest 
in the areas of plcicement, fol low-up j and,wo»;k experience,;: We 
now have staffing anfl -s system that -did not exist when COPES was 
■ here for a visi-t. In .addition, many areas* of vocational edutatioh 
. have been updated, in *facil ities and equipment which- ties u Its in*;** 

* better conditions -for^ student leaigiing." ■ ^ . . 

' ■ ^ , _ ' • ■ 

."We have more individual ized'instruction now, 'but this is not a 
direct result of 'COPES.- The COPES profile, iiowever,' was ,one of 
many reasons for our .efforts." * ' 

"A major; effort of occupational staff in developing a program 
eva^luati'on process will ^undoubtedly prove tp have a major impact 
on program quality and thus on student success, in the worlcKof 
work." ' 4 ' 

' "Major rfor handicapped students, minimum fot^ others." 



"More departments, are njoy.ing toward self-paced, individual f^d^"" 
instruction. " . ' • 



"T*e communication between the occupational education feiculty 
,and<lie counseling department has increased greatly. This has 
provided students with more up-to-date counseling information." 



rV 



"Curriculum modification." 
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Did COPES improve the quality and avatUbility of occupatid'nal education 
at your college? ^ ' ' ] ] 

"There was improvement in quality of instructi^ due to instructors 
self-evaluation in the COP^ process. Also the study made in- 

^ .stru):tors, .couriselors, studen^ts, admin-istration, and advisory 

committee members feel pride in their pa7ticipatian irf the programs 
As one instructor said, 'Just-think; this is one. time v/hen occupa- 
tional education is in the. limelight. '"^ . , ' 

•* • . ~* ^ ^ , 

"COPES made us aware, Of the need to become ffi'ore community-oriented, 
to analyze community needs, and to engage in student r^ecruitment. 
Our efforts in these regards have proved very successful. During. 
1974-75, for exalnple,3a major student recruitment effort was put , 
forth; it. realized a better than 25 per cent growth."^ 

'^Course outlines have been examined and 'updated as per COPES' 
. suggestion." - ^ " ^ ' ^ ' . 

"Yes, by adding staff in occupational education and by focusing 
• attention on occupational education, resulting i'n better .facilities 
and equipment." ^ 

"It reaffirmed. where our effort should, be pUced ''^, 

. "Due to increased administrative staff Jlnd relealed tfirie fpr 
division chairmen^ jrf^itiy new grograms are iiow being considered and 
some have already* been implemfen^ted. " 

"The faculty ^di^ sex\B\^\t^^^;^^ n]|^ds of community and students 
in the occupatronal ; educa^^^proces 

"I don't tnink sb:^. We have -ggo'd ^programs arid^new t^gy^wafe^good 
*Mong before COf>ES visi^ted ds.^^^ ^' ? -4 ^ ' ' 

"No . . We are out of f ac Hit 1 es- and^^i^y , change '^1 n "pf pgratijio^. ' 

offerings has been made. ' Those tha|L^aVa.:bee^^ M^rQ ^\oi l\\e^ 



"COPES has expedited- recognition of the need fc^^-i^pr^o^eiuents* 
In occupational education and cortsequently has bKougtit 'about a , 
coordinated effort toward this end. This is an cmgo^^4^^cess. 
with continuous Improvement in mind." * ' ' ^ ^ ^ 

"Yes. The board and publfc became more aware due to the /^m^ , 
visit and reports; thus. more support was generated." . ^ 

"By following as closely as possible the suggests ohsfunade in 

the COPES report, many areas of occupational educatibnt have been^ * 

improved. Including relief oflwork Joad by the vocational dean." 



result of the COPES visit." - . 
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"Because^of'^the ^needed -administrati^'e support anT"reQognition> 
there iFnow a'n associate dean for yocational education who has 
- " the responsibility and authority in regard to program planning, 
, budgeting, and-scheduling which has made many of the neetfed^ . 
.-changes possible. We^iill have a long way to go, but we are , - 
. goin^/? . r . ^ 

"COPES provided us with a^positjve feeTing we were doing a good . 
* job. It also pointed oiit 'soifielbf the areas where we knew we . 
could improve and, in doing so, caused us to do so/' 

"Increased use of advisory committees. Faculty load study dnd - 
^ new policy. Counselors are now-assigned to*advisory' committees 
\ to'assist in understanding prffgrams^ andf opportunities. Learning 

packets, tutors, arid career center ^have tieen initiated." 

"Yes. All recommendations were implemented." 

"Many of the improvements were in the planning stages and would 
have taken place anyway— COP£S or no COPES. On the other hand, 
the COPES repoK helped support and pirif^v^t our needs,, and may 
have been a contributing factor to our obtaining the improvements 
needed." . ' 

^ . ^ ; • 

"The big thrust is more a result of new leadership than COPES. 
The COPES profile was used by the nisw deanjn confirming 
•priorities." * V ' . ^ " 

"The SAM system has been implemented for student follow-up. 
Hopefully this will assist irt program development-." - ; 

".Yes. COPES facilitated the establ ishment.of a placement 
. office and upgrading of the follow-up process. It also stimu- 
lated interest in development of a program evaluation model "and 

in producing meaningful job market analysis studies."* \ 

"Varies with areas.- Emerging services and programs were en- 
couraged. Instructors were given^'a boost in morale. Adrain-:^ 
istration was sensitized to communication and planning needs." 

f "COPES encouraged idepartments to look anew at their programs 
and teaching methods." . ' ^ \ ' 

"COPES brought abo^L increased aWareness of occupational educa- 
tion opportunities on the part of counselors and academic - ' 
" faculty." 

Mere there any other effects Tpositive or neg»ti>yA) resulting from th^e 
COPES vi^it? . - " "T""'^ ^ 

"Communications with our sister colleges,- an area cited ars an 
^ improvement need by the COPES.y^team, have improved dramatically," 



"The effects of the COPES^ visitation we^e positive, making many 
on campus aware of facets of cjyr occupiftlanal program -that other- 
wise would have remained obscure and unidentified. I believe-the 
. total siaff saw a dimension"" to the program V/hich they had not 
previously conceived or thought significant." 

"A^very positive outside verifying source- that has an effect 
..^for many years." * * 

"The college is in the process of organizational restructuring. 
The president, having- been involved in the C0PE5 evaluation^ 
has become sepsi'tive to occupational programs in relation to 
* community needs. He has, in the reorganlzational process,- taken 
^^ertain recomnjendatioqs made by the COPES team and has implemented 
these concepts in the restructuring." " ' 

"For a period of time the occupational education faculty was 'up'" 

"The only effects wer6 positive in nature. Havirvg outside re- 
' presentatives with expertise in t'he occupational areas lent' 
^^^credibility to the study." 



^'As a result of pr&paring for the COPES visitjind meeting with 
the COPES team,. members of the staff at- the t:olTege seemed to 
develop a greater feeling of togetherness aiid .a greater feeling 
^tfthe importance of vocational education. '^AddijiionallysY^Qur 
people seemed, to collect new ideas from each of the indivi)lual 
COPES team members.'^ ^ 

"Many faculty felt they were interviewed by people 'selling' 
the^r own thing.". ' 



\ 



"I am sure there were, but it is difficult to break out specific 
instances. - Most^pf the efffecb has been in terms of purpose or 
philosophy. I'doh/t want yqa to assume that all occupational 
education staff are standing'^shoulder to shoulxier, but 90% of ' 
bdr .people have come alive and are involved. Perhaps jou might 
say that they are, becoming more professional." 

"Occupational staff feeV they and their programs are always 
being evaluated and that the academic area is not going thrpugh . 
this to such a degree." . 

"Staff became^re aware of criteria for evaluating the quality*- 
of occupatioffal education programs." . . * 

."There was good feeling by staff a^ to the qualifications of tKe 
'COPES team members, and staff valued the oppjortunity to share- 
idea-l with them/ On the other hand^.there was a distinct feeling 
that certain team members. were measuring our college ijn the light 
of what they were doing in their own college and, as a result, 
missed some of the. unique characteristics here." , 

"There is now better commiini cation between a(lniinistreition""and 
-..opcupational ed'acation faculty." • , — ' . • 



'\.5 



57 K. '5 



Appe^idix C-5 
CONFIRMATION OF COLLEGE RESPONSES 

^' ' '4. 

VALIDATOR FINDINGS ' > • * 



^ (N = 18) • ^ 

Question: Does your college visit confirm the college responses to 
questions 3 through 8? . • 

3. To whom was the .COPES l^^ritten report distributed? 
Confirmed - .16 



Not Confirmed - ^'Z (Validator explanations: At one college, ' 

distribution was not as widespread as re- 
pfiirted, because of different interpretation 
given to meaning Sf a category of possible 
recipients; at the other college, distri- 
bution was greater tham reported.) » . 

. ' • 

4. What difficulties were encountered in implementing the COPES j 
recommendations? ^ ^ ' . ' i * 

Confirmed - 15 ■ ^ - ' • ' 

Not Confirmed - -3 (Validator explanations-: Diff icullies not . 

reported but noted during visits were lack 
" , of administrative commitment at two colleges. 
•Af thi rd. col 1 ege,' wher.e ma.il ed response-had— 



cited generality of .recommendations as an 
\ obstacle ta implementation, jsite visit 
interviews did ^riot-bear this out.) 

5. What was t^e impact on^tudents by implementing the COPES recommendations 
Confirmed - 16** ' . . 

Not Confirmed - 2 (Validator explanations: »At one college, 

. . impact appeared to be greater than reported,- 

through implementation of Student Accoanta- ^ 
" bility Model for follow-ups at the other 
college, impact appeared to have been' 
overstated..) * . 



7^ 



16. Did COPES improve/the quality and availability of occupational 
education ^t your/ co^ege? . , ^ 



Confirmeg - 17 



Not Coftf irm^d . 



- 1 




(Val-idator explanations: While college had 
£l^imed achievement .of improvements ^little 
oPno evidence was perceived during site ' 
visit;, interviewees blamed tjae situation on 
a "recalcitrant superintendent/') 



7. In your opinion, what^action shoulxl be taken to increase the impact 
of COPES? 



Confirmed - 15 

* 

Not Confirmed - 1 



m: 



NR 



(Validator explanations: Whereas college 
respondent had suggested that COPES- provide 
leverage toward, institutional-.implejnentation 
of r*ehommendations', -site visit inter\4iewees 
did not think this weuld be apprqpriate. ) 



w 

8\ Were there any other effects (positive or negative) resulting from 
the <fOPES visit? • * ' 



Confirme'd - 15 
Not Confirmed - 2 



.(Validator explanations:,- At one coll'ege, 
other pbsitfve effects appeared to be 
greater tHan reported'^ at the other, ^site 
visit interviews did not bear out other 
■positive"' effects, citect in'mailed response.) 



NR 



•IV 



Source:' Si-te visit .interviews and observations? 
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Appendix C-6 

additional/ college improvements creditable to COPES 
^ l/ALIDATOR FINDINGS • 



Question: Are there other improvements {not previously noted) in th6 
quality and availability of occupational education^at the - 
college as a result' of COPES?. If yes, pTedse specify. 

■ ' V ■ ^ ' . ; . 

Area^f. Improvement •, • Mentions 

~: .. . (N = 9)* 

Better provisions for handicapped students ' .3 , . 

.Better college "climate" concerning occupational ^ " * . * 

education / , ' . '2 

Better coordination of occupatioigal education * . . ^ 

GrowthMiKOCCupational offerings " ^ ,2 • 



•More effective placement services . 2^^^ 

Addition of instructional equipment ' ^1 

Better services for disadveTntag^ed student^ ^ ^ 1 • 

' Better use of advisory committees' '\ 

E^ablishment of career center ' 1 ' 

More equitable. representation.' of occupational 

education interests on curr4culum committee^ * 1 

' *At nine colleges, no improvements^ beyOnd those previously noted Were 

. identifieitj - • ^ • * 



Source: S.ite visit interviews and observations* ; * 
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Appendix C-J- 
VALIDATOR COMMENTS 



"Eighteen of the 22 people I interviewed at the colVege had surprising 
recall of, the^OPES team visit four years ago. . All 18 were knowl^dg^abl?. 
of the c'riticah-ft^ds. The president was mos1: positive arid proceeded 
to list the .college response^ to the Identified critical^ needs. In my 
: judgment, liine of the 11 have receivect^attehtion. Of the other two, ^ 
placement ha^s been given some attention,, but not effective. L'east 
attention has been given to follow-u|).^ • • , 

'XOPES helped them realize that a small college cannot be all things to 
•all people. They are how concentrating jnore^emphasis on^'less i)rogramsr-' 
' strengthening thfem— and stopping the.earjjier proliferation." ^ ^ 

."There has been a rejuvenation of a cooperative attJtude"'among the 
vocational education staff." ' ' ' " . 

"pne thing that came through in today's interviews Was tW credjt given 
the whole COPES process for motivating arid sttmulatirig staff to r^^flect 
on what, is and what ought to be- A number volunteered the belief that 
the'COPES approach is superior to accreditation as a process." ^ 

"All tho^e interviewed expressed the opinion that COPES 'created a^ 
climate for change. They were unable to cite any changes as a direct 
result of COPES but felt that the changes which did. occur rpight not 
have^-or at least might not have so quickly— had not COPES been u'tilfzetla^; 

"The admirAstration led the foTHnation of task forces to work on recom- 
mendations to implement .the GOPES suggestions. The faculty reacted, 
positively to the'ta'sk; however, when' some, recommendations were not 
.implemented, sofnejieciativisfn developed Within fa^:ulty. " 

"The COPES process was ^ery ^profninant in mpving the college to^ mobilize 
for action. It was a yery positive direction." - 




...APPE^IX D •-. 
- DETAIL ON: SYSTE-M" ASSESSMENT 



D-1 Suggested Actions to Increase Impact 
• 'OF COPES -. College Respondent Per<:eptions 

D-2 Selected Respondent Comments . * 

D-3 Suggestions for Improving COPES -€ral and 
Written Reports - Validator, Perceptions 

D-A" ^ SEtE&TED ^VaL4DAX0R. CoMMEMS • - - 
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Appendix D-1 

SUGGESTED ACTIONS TO INCREASE IMPACT Of COPES * 
' '*., ■ • ; * 

' COLLEGE RESPONDENT PERCEPTIONS .' " 

. ' . ^ . — 

Question: In your- opinian, what action shduld^^^e^taken" to increase the 
impa-ct of COPES? ' • . 

Aria of Action ^ . i ' Mentions 

. ^ ' (N = 26)* 



Make l^egular provision for' determining extent' of 
colleges' implementation of COPES rec6mmendations 9 

Provide consultation to colleges on^ implementation . *^ 

af recommendations - ' t -5 

r^e^ore specific in recommendations 3- 

/» »■ * , 

^Jfflprove in-service training for COPES team members * ' 
regarding visitation purpose (to'minimize preconceptions ' 
and '*s:e1]ing'* of members' "pet ideas") . ; ' 2 

InvoTv^ academic^faculty of cooperciting col leges in ^ ^ 
COPES process • ^ > 2 ^ 

Be mor-e candid in team reports to colleges 1 

Continue present practice of adding, more community * - 

college professional s and lay persons, to validation 
cadre each year 



De-emptiasize focus on set-aside funds -and programs 
. ^ * ' - ' \, [ 

Encou^^a^e cooperating colleges to m^ke COPES 
,.orieata±ion presentation to their boards of trustees - . 

.Have jDne pe^rson visit-each college instead. of us4-ng 
a teanr"*' * . ^ ^ - 

Integrate with accreditation process 
"'Pravi^jj^orksihops for occupational instructors- 
Secure wider dissemination of team reports 

*Respp'n^ents at seven colleges had no opinion on,, or did not respond to, 
_thisf.ques.tion. Respondents at five colleges rated COPES sound as is. 

respondent questioned the need for further devel opmef^t of COPES in view 
..of exi^sting self-evaluation technique? and accredi):ation provisions. 



Source: ^ Mailed responses. . . 



Appendix D-2 
SELECTED RESPONDfNT COMMENTS 

In your opinion^ what action should be taken to ^increase the impact of COPES? 

"-"I Relieve COPES* impact is being felt throughout the state. Site 
visit chairpersons are becoming more cognizant of their need to know 

^ something about^ the college, its particular role in the Community, 
and its objectives. Perhaps more in-service training is needed for 
^ other team* members so as to make them more fuljy aware of the COPES 
fur\clion in visitation." ^ ' 

"I tftijik the COPES recomme^fdations were fair, reasonable, and did in; 
fact"^ recognize areas of needed improvement." 

"Continue the prpject, and continue to involve additional cornmurvity 
/'cpllege staff and also lay persons." ^ 

"None, unless tt Were feasible to refer an expert to the college ' 
who could suggest ways of meeting the recommendations." 

"A foVlow-up- team consisting.,of a superintendent and a dean of \ 
vocational education to visit the college where COPES has visited. 
The purpose would be to 'meet with the superintendent ^^nd board^ 
members to discuss the COPES recommendations." ^ 

"Develop techniques to inform and involve non-occupational facuTty-- 
^ " ^ell, the program!" 

"With self-eva>ua{ion techniques, plus the WASC formal accreditation 
pw£iBdures, it would seem questionable to further develop COPES." 

•r 'l^Trly visit by a single member. Do not need a' large entourage." 

"When areas of weakness which deserve specific recommendations are 
found, these areas should be given greater emphasis and specific, 
detailed justification in both written and oral reports."' 

"Visitors should come' with fewer preconceived notions arid more ^ 
current understanding of the world of occupational education." 

"A regular procedure of having a follow-up vis»it to -the campus by 
perhaps "one member of the original team is needed. He should 
rfocus on COPES *recommendat ions and document in a written report * 
those that have been implemented." 

"Might be controversial, but maybe during, the planning^stages 
suggest that a pre§entation be. made at a regular meeting of»?*the , 
board of trustees. This certainly would stimulate more interest, 
as well as providing a platform for the final report?^^ 
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"It is soupd as it now st"ands..,'>' ■ > ^ c 

"It would be-well if COBES could be- integrated with the total - 
accreditatiqri process. It is difficult" for a college to gear up 
^for^separate evaluations." , 

"The Ye^o^to I He' col 1 6ge ' shbul ti ' be mor e frank in the areas of 
■administration." " ^ ' 

"Refine the' questionnaire so niore specific recopiendations can 
-Jie-inad,e,_.ipjn,4,mo/e time on the regular program, and less on the 
special set-aside Vuncfs'^ahd'pVdgrams." . • ° 

-^a)::ks hops -should, be provided for occupational instructors." 

i^^ne improvement could ra^lt in -zeroing in on specific aspects of 
^vocational education if. the teams -could be "made of experts in that 
.'area. After a "general visit >y COPES, a follow-up team of this ., 
na-^Y^e' could be helpful in. improving those areas identified as 
jTeeding the most attention on a particular campus." 

"None,'=^sDTa.r as COPES is concerned, but I feel admin istra^itors 
lat-eTesponsible for wider dissemination bf the findings." 

* 

The present *COPES procedure- i§ doing a good job."' 

V 

. "Make the -total facu-lty a\^are.of the occupational. educatioxi . 
-^iprograms and^ problems on campus." * * ' • 



Appendix D-3 

SUGGESTIONS FOR IMPROVING' COPES ORAL AND WRITTEN REPORTS. 
• VALIDATOR- PERCEPTIONS 



Question: Do you have suggestions for improving COPES oral reporting? • 



If yes, please ^specif^. 
Area to Improve - 
Be more specific 

encourage attendance of mof^ col lege pVsonnel , 
including academic facul^ • ^ 

Allow more time for questions from the atidience 
and discussion * . * 

Provide^a common reporting. format^ for use by 
'all teams 



Spen^ less time on protocol ma^tters 
Transcribe and distribute the^report 



Mentions 
(N .= 11)* • 



4 
2- 

1 
1 
1 



Question: Do^ou have suggestions for improving the COPES written report? 



7 ^ 



Be more specific % ; 

.Secure wider di-stribution of ^ the report and/or- certain 
appendixes (e.g., student and advisory^conunittee 
inputs) . . ^ ^ ^ 



Make suggestions concerning implementatior/ of 
recomiflendations 

Provide 'tn-serv1ce. training for college stKf on 
use of the report " 

*In seven instances, validators made nO improvement suggestions. 



^- 2 
1 • 



S'ourcef'' Site visit interviews and observations. 
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Append fx 0-4 
SELECTED VALIDATOR COMMENTS 



Oral report 



• "It might be better if a coitmpn formar were Used by all teams^where 
° the team chairman is. the sole reporter with other members there for 
questions. Also, it wa5 reconmended by some interviewees that more 
•time be -devoted for 'questions and discussion." < . •• 

' "Thoiigh the oral and written r&ports were favorably rated by- 
respondents, several felt both should be more specific in opera- 
tional terms. Such. specif i-city cafTBrTchieved without being 
prescriptive." . . ' * . 

■ / % , 

"My own feeling after' the visit is that p'erhaps the teams' are too 
concerned wjth protocol. Perhaps more emphas'is could be placed on 
the 'meat' issues." _ ' 

"With no "exceptions the interviewee's all felt the report was well • . 
done." • ■ , . 



Written report ... . . ■ ' • . , ... • ^ ^ 

"The report was given high. marks'. , The only criticism heard was ^ 
lack of specifiC'i:ty." " * ' 

* 

"Other than the very few people who read it or do much with It, the 
■ written report had little impact. One suggestion would be to in- 
service staff on how-to. use it.'' • ^ 

"People at the college I visited would likeNto.see some suggestions 
on implementation of the recohmendatiplis .'■ y ( 

"While I can understand the difficulty of widely distributing the 
appendix material of. the wmtten report because of the amount of 
paper involved, some of .these appendixes should be widely read— 
^f or example, students' inputs and those from advisory committees. 
Possibly some reorganization of the appendix material would be 
the. answer, or a suggested 'summary'— to include most o.|^narrative, 
plus key appendixes."' ' , 

."A reSbmmended. systematic- procedure for distribution and discussion 
of the- written report should be developed, it is distributed to a 
restricted few: casually discussed, artd forgotten." 
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-"We should stay oUt of colleges that cire torn apart by turmoik"' 

"Most interviewe'es focused on the timej imitations of the COPES team 
visit and the unfulfilled expegtatiohs that many on the faculty 41? d. v\ 
.of 'meeting with m'embers of the team. Suggestions Wde'included \ . 
extending the length of the site visit and making certain that thof^^ 
wh^) participate in a study of this type are afforded the opportunity, 
of interviews J" 

"I disagree, bu,t some of the adrpinistrators^ at the college'I lyisited 
would prefer to have the teams treated as consultants rather than 
evaluators. Also, in sofne casds, there needs to be better orienta- 
tion of the lay representatives on the teams." ^ 

"The initial meeting with college staff should, include all people 
involved with occupational programs. ' If possible, the exit pre- 
sentation should also involve everyone." 

"Some people at the college questioned the attitude oT the teanr. 
No one, for example, is going to ding, a school when they' will be 
subject fo the same process someday.' Some ideas to remove this . 
stigma would be to use a* completely independent third party, W 
to merge COPES wit ff WASC." . , - , 

"There could be a regular pattern of follow-up at the participating * 
colleges- two to three years later, with a formal repert on flfnple- 
mentation of recommendattions." . - 

"Once ah overall evaluation has been done; a follow-up should be 
made with an in-depth evaluation of specific occupational areas. . ^ 
Or staff should be in-serviced to conduct their own e^7aluation; 
the coll*ege could finance a team of peers to validate the evaluation." 

"Recommendations must be more directive to be effective. " 

"Require a board response that indicates they know about the 
recommendations and have directed some cK:tioin fron} administration." 

"Academic people should be aware of and participate in the t)rocess>" 

"Yearly revisitation as ^ prod to accomplishment:" ' ^; 

"Dissemination of COPESV ove^al\ reports on status of occupatlcfnBl 
education and subsystems should 'be expanded to Include state legis- 
lators, college presidents, the Postsecondary Commission, the Board 
of Governors, and the State Advisory Council on- Vocational* Education* 
The political ,Alout of these groups necessitates keepins themj'n- 
formed on COPES! They^^^should consistently receive COPiS informational 
brochures, as ^well ." * ^ 
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* • "More clarity isL needed in the evaluation form items. Where^^ - /- 
• '" possible, they should also be made briefer. Double meanings -should / 
' be avoided." ' " -'^ 

^ "The. *don't know' xo-lumn in the instruments, should, fee divtd'^d into 
•don^t know* and *not relevant to respondent's responsibility.'" 
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